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ABSTRACT 

In  this  paper  we  present  an  algorithm  to  solve  the  static  problem  of  associating  data  from  three 
spatially  distributed  heterogeneous  sensors,  each  with  a  set  of  detections  at  the  same  time.  The 
sensors  could  be  active  (3D  or  2D  radars)  or  passive  (EO  sensors  measuring  the  azimuth  and 
elevation  angles  of  the  source).  The  source  of  a  detection  can  be  either  a  real  target,  in  which  case  the 
measurement  is  the  true  observation  variable  of  the  target  plus  measurement  noise,  or  a  spurious  one, 
i.e.,  a  false  alarm.  In  addition,  the  sensors  may  have  nonunity  detection  probabilities.  The  problem  is 
to  associate  the  measurements  from  the  sensors  to  identify  the  "real”  targets,  and  to  obtain  their 
position  estimates.  Mathematically,this  (static)  measurement-target  association  problem  leads  to  a 
generalized  three-dimensional  (3-D)  matching  problem,  which  is  known  to  be  NP-hard.  In  this 
paper,  we  present  a  fast,  but  near-optimal  3-D  matching  algorithm  suited  for  estimating  the  positions 
of  a  large  number  of  targets  (>50)  in  a  dense  cluster  for  real-time  applications.  Performance  results 
on  several  representative  test  cases  solved  by  the  algorithm  are  presented. 
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I.  INTRODUCTION 


The  problem  context  for  this  paper  is  as  follows:  we  are  given  a  set  of  three  heterogeneous 
sensors  at  different  locations  in  a  given  surveillance  area,  each  with  a  number  of  detections  at  a  given 
time.  With  each  detection,  there  is  an  associated  measurement  originating  from  a  source.  The  set  of 
sensors  can  consist  of  passive  (Electro-Optical  or  ESM)  and  active  (3D  or  2D  radar)  sensors.  A 
passive  sensor  measures  the  azimuth  and  elevation  angles  of  the  source,  a  2D  radar  measures  the 
range  and  azimuth  angle  of  the  source,  while  a  .sD  radar  measures  its  complete  position.  Other 
configurations  of  sensors  can  also  be  used,  e.g.,  with  jammed  radars.  The  source  of  detection  can  be 
either  a  real  target,  in  which  case  the  measurement  is  the  true  observation  variable  of  the  target  plus 
some  measurement  noise,  or  a  spurious  one,  i.e.,  a  false  alarm.  We  allow  for  missed  detections  by 
the  individual  sensors.  In  addition,  each  sensor  has  a  finite  resolution.  Therefore,  not  all  targets  are 
detected  by  all  sensors.  The  problem  is  to  identify  the  number  of  targets  present  in  the  scenario,  and 
find  their  (static)  position  estimates.  The  central  problem  of  multisensor  multitarget  state  estimation  is 
that  of  data  association  -  the  problem  of  determining  from  which  target,  if  any,  a  particular 
measurement  originated.  Measurements  originating  from  a  particular  target  can  then  be 
3D-triangulated  to  estimate  the  states  of  the  target.  Typical  applications  are  in  sonar  tracking  and 
space  surveillance  using  passive  sensors  and  radar  tracking  in  the  presence  of  electronic 
countermeasure 

For  sparse  scenarios,  one  may  be  able  to  place  most  targets  into  "unique”  target  planes  defined  by 
the  sensors  (EO  or  3D  radar)  and  a  target.  However,  in  scenarios  involving  a  large  number  of  targets 
in  a  dense  cluster  (for  example  a  squadron  of  jets  flying  in  formation),  multiple  targets  may  appear 
in  a  given  plane  resulting  in  the  spurious  (ghost)  targets  due  to  false  triangulations  of  the  line  of  sight 
measurements.  The  ghosting  effect  can  be  significantly  reduced  by  using  three  sensors.  A  global 
optimization  algorithm  can  then  be  employed  to  identify  the  most  likely  associations.  Unfortunately, 
the  3-D  1  matching  problem  can  be  shown  to  be  NP-hard^  f 2],  even  under  the  assumption  of  zero 
false  alarm  and  unity  detection  probabilities. 


*  For  the  matching  problem,  the  number  of  dimensions  is  equal  to  the  number  of  lists  to  be  matched.  Therefore,  the 
dimension  of  the  matching  problem  is  the  same  as  the  number  of  sensors  in  the  scenario.  To  avoid  any  confusion,  the 
dimension  of  the  matching  algorithm  is  refened  to  as  "3-D",  and  that  of  the  measurement  space  as  "3D". 


^  This  means  that  an  optimal  algorithm  for  the  multisensor  (>3)  data  association  problem  with  a  run-time  bound  that 
is  a  polynomial  function  of  the  number  of  sensor  reports  exists  if  and  only  if  all  the  combinatorial  problems 
belonging  to  class-NP,  including  the  traveling  salesman,  maximum  clique,  and  the  satisfiability  problems  can  be 
solved  in  polynomial  time  [1].  The  evidence  indicates  that  in  all  likelihood  any  problem  which  is  NP-hard  can  not  be 
solved  by  an  algorithm  of  polynomial  time  complexity. 
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In  this  paper  we  develop  a  three  sensor  data  association  algorithm  suitable  for  dense  clusters.  The 
key  features  of  the  algorithm  are  as  follows.  First,  we  provide  a  unified  framework  to  consider 
two-sensor  and  three-sensor  detections.  In  dense  clusters,  sensor  limitations  may  result  in  missed 
detections.  Therefore,  a  certain  number  of  targets  are  to  be  resolved  using  two-sensor  measurements 
only.  In  our  formulation,  we  assign  dimensionless  "costs"  to  two-sensor  or  three-sensor 
associations,  thus  enabling  us  to  globally  optimize  the  set  of  three-sensor  and  two-sensor  detections. 
Second,  we  are  not  restricted  to  passive  sensors  only.  In  this  paper,  we  present  techniques  to 
associate  data  from  passive  sensors,  3D  and  2D  radars.  Our  methodology  extends  naturally  to  any 
sensor  type  (Azimuth-only  passive,  jammed  radars  etc.).  And  third,  we  have  developed  a  fast, 
iterative,  near-optimal  polynomial-time  algorithm  to  globally  optimize  the  association  accuracy  of 
measurements  to  targets  detected  by  at  least  two  sensors.  The  algorithm  provides  a  conservative 
estimate  of  the  proximity  of  a  feasible  solution  to  the  optimal  solution.  Thus,  in  time-critical 
situations,  we  may  truncate  the  algorithm  at  deadline,  and  still  have  a  good  feasible  solution,  and  a 
measure  of  its  accuracy.  Solutions  generated  by  the  algorithm  are  typically  within  2%  of  optimality. 
The  details  of  the  Lagrangian  (dual)  relaxation  algorithm  may  be  found  in  [3,4],  The  Fortran  Source 
Code  of  the  algorithms  presented  in  this  paper  are  also  available  with  the  interactive  software  [5]. 
The  performance  results  for  some  typical  scenarios  are  presented  in  Section  3. 

II.  PROBLEM  FORMULATION 


2.1.  The  Model 


We  assume  that  the  position  of  target  t  is  described  by  its  Cartesian  coordinates, 


ffli  =  l  xt  yt 


(2.1) 


and  that  there  are-T  targets  in  the  surveillance  region  (T  unknown  and  to  be  estimated  by  the 
algorithm).  The  three  sensors  are  assumed  to  be  non-collocated  with  known  sensor  positions 

0)s=  (xs  ys  Zs  iT  ,  s  =  1,2,3  (2.2) 


We  allow  missed  detections  and  false  alarms  in  our  problem  formulation.  Each  of  the  sensors  can 
be  one  of  the  three  types:  a  3D  radar,  a  2D  passive  sensor  or  a  2D  radar.  The  passive  sensor 
measures  the  azimuth  angle  0S(  and  elevation  angle  cpstof  each  potential  target  t.  A  2D  radar  measures 
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only  the  azimuth  angle  0S[  and  the  range  rsl.  A  3D  radar  measures  all  three,  that  is,  the  azimuth  angle 
9st,  the  elevation  angle  <pst  and  the  range  rst.  In  order  to  present  a  unified  sensor  model,  we  define  a 
(nonlinear)  transformation  Hs  on  the  true  position  vector  and  sensor  position  co  s  that  generates 
the  measurements.  Let 


Hist  =  Hs  (Wt  ,  CDs  ) 


(2.3) 


where,  msl  =  [  9st ,  <pst]  for  a  passive  sensor,  m^  =  [  0sl,  rst  ]  for  a  2D  radar  and  msl  =  (  9sl,ipst, 
rst]  for  a  3D  radar.The  measurement  is  ( is  =  1,2,..,  ns)  of  sensor  s  is  modeled  by: 


=  { 


mst  +  Vsis  if  origin  is  target  t 


Wei. 


and 


if  spurious 


2Lsis  —  [  zsisO)  zsis  (2)] 
for  passive  sensor  and  2D  radars;  and 

Zsis  =  [  zsisd)  zsis(2)  zsis(3)  ] 


(2.4a) 


(2.4b) 

(2.4c) 


for  3D  radars.  The  statistical  errors  associated  with  the  measurements  of  true  targets  are  assumed 
Gaussian 


Vsis~(V( o,ls) 


(2.4d) 


where  Zs  is  a  diagonal  matrix  with  the  diagonal  elements  denoting  the  variance  of  the  measurement 
errors. 

The  measurement  noises  are  assumed  to  be  independent  across  sensors.  We  let  Pps  denote  the 
detection  probability  of  sensor  s.  We  assume  that  the  density  of  spurious  measurements  is  given  by 

Pw  (w)  =  -L  (2.4e) 

where  4^  is  the  field  of  view  of  sensor  s.  For  example,  H's=H/0H'(j)4/r  if  sensor  s  is  a  3D  radar, 
where  Tq  is  the  azimuth  field  of  view,  and  4^  is  the  elevation  field  of  view  and  H'j.  is  the  range 
field  of  view.  The  spurious  measurements  are  independent  of  each  other  and  of  the  target 
measurements. 

To  simplify  the  notation  for  incomplete  measurement-target  associations  caused  by  missed 
detections,  we  add  a  dummy  measurement  zs(;  to  each  of  the  measurements  of  sensor  s.  We  denote 
the  set  of  measurements  from  sensor  s  (including  the  dummy  measurement  zs() )  bv 
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(2.5a) 


Zs  -  (z.su  },?=0 


and  the  set  of  measurements  in  the  entire  surveillance  region  by: 


2.2.  Partitioning  of  the  Measurements 


Consider  a  3-tuple  of  measurements  denoted  by 


~  (  Zsi,  ) s  =  l  (2.6) 

The  dummy  measurements  zs()  .  s=  1,2,3,  enable  us  to  consider  all  measurement-target 
associations  (including  single  and  two-sensor  detections)  as  3-tuples.  The  likelihood  that  sensor  1 
missed  the  target  at  location  and  that  the  measurements  i2  (>0)  and  i3  (>0)  of  sensors  2  and  3 
originated  from  the  target  t  is  given  by  : 


M  Zq  i,i,l  Wt) 


(  1  -Pd,)Pd2  Pd,  p(Z2i2l  COt)p(Z3i3IWt)  (2.7) 


In  general,  the  likelihood  function  of  the  3-tuple  Z^j.^  being  the  set  of  measurements  that 
originated  from  the  same  target  at  location  is  the  mixed  probability  density-probability  function 

3 

A(  Zj,  i2i,  I  (0t)=n  (PDsP(zslj0Jt)|u(i'')  [  1-Pds] ^ 1  ■  (2.8) 

s  =  1 

where  u  ( i  s )  is  the  binary  indicator  function  defined  by 


Denote  by 


it  is  =  0  denoting  a  missed  detection  by  sensor  s 
otherwise 


(2.9) 


Y  =  I  Z,  ,  Zf  | 


(2.10) 


a  feasible  partition  of  the  set  Z  into  two  subsets,  namely,  the  subset  of  3-tuples  of  measurements  Zt 
(  Zjj  i2i3  •  's  ~  o,  1 ,2 — ns ,  s  =  1,2,3}  associated  with  targets  (tuples  with  at  most  one  dummy 
measurement,  i.e.,  2  or  3  actual  measurements),  and  the  subset  Zf  =  {  zsj  :  is  -  l,2,..,ns ;  s  =  1,2.3 
^  _  (  Zj|0() ,  Z(),2o ,  Zqq^  :  is  =  1.2,..,ns  ;  s  =  1,2,3},  of  spurious  measurements  not  associated 
with  any  target  (tuples  with  one  actual  measurement).  Note  that  a  partition  also  implies  a  set  of  true 
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target  positions  (at  the  given  time  under  consideration)  to  be  estimated. The  rationale  for  this  division 
is  that  at  least  two  measurements  are  needed  for  a  full  position  estimate  in  the  current  static  data 
association  problem. 

The  feasibility  of  the  partition  requires  the  following  : 

( 1)  Each  sensor  measurement  belongs  to  a  target  or  a  false  alarm 

Z  =  Zt  U  Zf  (2.11) 

(2)  Each  sensor  measurement  belongs  to  one  target  only  (Note  that  the  dummy  measurements  may 
be  associated  with  multiple  targets.  In  other  words,  an  unlimited  number  of  dummy  measurements, 
each  associated  with  a  unique  target,  may  be  added  to  the  partition.) 

Zi;  i2i3n  Zj  ,  i'2n=  0  for  any  is*is  (is*0,is*0),s=  1,2,3  (2.12) 

Corresponding  to  a  partition  y ,  one  has  the  event 

(  y  )  =  (  partition  y  is  true  }  (2.13) 

We  denote  the  set  of  all  feasible  partitions  as 

r  =  {  y  }  (2.14) 

In  order  to  normalize  the  likelihood  function  so  that  it  is  independent  of  the  number  of 
measurements  from  each  sensor  and  of  the  number  of  hypothesized  targets,  we  define  the  partition 
y„e  E  as 

Y  o  =  (  Zt  =  0,  Zf  =  Z  }  (2.15) 

The  partition  y0  corresponds  to  the  hypothesis  that  the  number  of  targets  T  is  zero,  and  that  all 
measurements  are  spurious. 

The  most  likely  partition  of  the  measurement  set  Z  into  target-originated  measurements  and  false 
alarms  is  obtained  by  maximizing,  over  the  set  ot  all  feasible  partitions  T,  the  ratio  of  the  joint 
likelihood  function  of  all  the  measurements  in  partition  y  to  the  likelihood  function  (LF)  of  all  the 
measurements  in  partition  yn.  Note  that  this  ratio  is  a  dimensionless  quantity.  The  maximization 
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problem  on  the  resulting  likelihood  ratio  (LR)  3  is  thus  given  by: 


max  — (2.16) 
ye  r  L(yo) 

where 

L(y)=p[ZlC(Y)]  =  [  11  A(  Zlll213|cot)] 

^»i  12  ije  Y 

■  i  n  er™ i  <217^ 

s  =  1  s 

and  Ts  (7)  is  the  assumed  number  of  targets  in  partition  ythat  are  detected  by  sensor  s,  and 

3 

l  <  ^>) = P  i  z  k  (-«.)  1  =  n  <2j7b> 

s  =  1 

Since  the  true  target  positions  £pt  are  unknown,  we  maximize  the  generalized  likelihood  ratio, 
wherein  the  true  target  positions  in  Eqs.  (2.8)  and  (2.17  a)  are  replaced  by  their  maximum 
likelihood  estimates  0)t,  obtained  from  the  3-tuple  of  measurements  Zj,  j2  j3.  That  is, 

ir  arg  max  A  (  ZM  i2  I  m  t)  (2.18) 

w  t 

Therefore,  Eq.  (2.17  a)  is  replaced  by 

L(y)=pf  Z|C(y)l  =  [  fl  A(Zi,  i2iJ  w  t )] 

Zi,i2i,e  y 

3 

.  [  n  (— )ns‘T,(Y)]  (2.i9) 

s  =  1 


'  Since  the  LF.  being  a  pdf,  has  a  physical  dimension,  one  cannot  compare,  for  example,  the  LF  of  two  targets  with 
the  LF  of  three  targets.  However,  this  comparison  is  possible  using  LR,  since  it  is  a  dimensionless  quantity  (6). 
where 
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(2.20a) 


fl  [PosN(ist,Ss  )]u(ls) 

.[  1  -  PDs( 1  *  u^)}  ] 

fisu=  HsCSt.ffls)  (2.20b) 

/V 

Note  that,  for  a  single  sensor  detection,  (&  can  not  be  estimated  uniquely  from  Eq.(2. 1 8)  in  the  current 
static  formulation.  (However,  when  the  static  data  association  algorithm  is  used  in  a  dynamic 
tracking  application  [7,8],  these  single  measurements  can  be  combined  with  existing  tracks  to  update 
target  position  estimates.)  To  avoid  targets  with  unobservable  states,  we  make  the  assumption  that  a 
target  is  detected  by  at  least  two  sensors  Thus,  the  3-tuples  of  the  form  Z^qq  (or  Zq^q  or  Zpo^) 
are  uniquely  associated  with  the  subset  Zf  only,  and,  therefore  represent  spurious  measurements  in 
the  current  static  formulation.  In  the  dynamic  tracking  application,  single  sensor  detections  and 
spurious  measurements  are  distinguished. 


A.  (  Zq  j2j3 1  (Oj  ) 
and  (using  2.3) 


nnq  Problem 


The  maximization  problem  posed  in  Eqs.  (2. 16)-(2.20)  is  equivalent  to  the  minimization  of 
negative  log-likelihood  ratio  given  by  : 


J  =  min  J  (y)  =  min  [  in  L  (yp)  -  In  L  (  y  )  ]  (2.21) 

ye  r  ye  r 


The  contribution  of  elements  of  Zf  to  the  negative  log-likelihood  ratio  cancels  out  (see  (2.17a), 
(2. 17b)).  Thus,  Eq.  (2.2 1 )  can  be  modified  using  Eqs.  (2. 17), (2. 19)  and  (2.20)  as: 

J(y)  =  [  In  L(y0)  -  In  L(y)J  =  X  c„ „  „  (2.22a) 

z,,,,  „e  7, 


=  I  {  u(is)  [-ln(PDs)  +  JL  (  zSIs  -  as.,  )^' 

•  (Zsu  -ii,  )T-ln - y]  -  [  1  -u(is)]  ln(  1  -PDs) }  (2.22b) 

2k  I  Is  | ]L  ' 
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The  minimization  of  the  negative  log-likelihood  ratio  can  be  recast  as  a  3-D  matching  problem  as 
follows.  Define  the  binary  event  variables  : 


Pi  i  izM 


r  1  if  the  3-tuple  Zi,i2i3G7 
0  otherwise 


(2.23) 


where  associations  of  the  form  (pjjOO.PoijO  or  PoOi3)  denote  spurious  measurements.  Since  the 
addition  of  measurement  Z^qq  to  subset  Z{  has  no  cost  penalty,  we  set  c^QQ^o^fpCoo^  =q 

Note  that  the  sum  of  squares  ot  the  differences  between  the  measurements  z^,.  and  their  estimates 
Usis in  Eq.  (2.22)  is  the  goodness  of  fit  of  a  triplet.  Since  there  exists  a  one-to-one  mapping  between 
the  binary  events  Pj,i2j3  and  the  feasible  partition  y,  the  minimization  of  the  negative  log-likelihood 
ratio  can  be  recast  as  the  following  3-D  matching  problem: 


i*  =  min  J  (  p  )  (2.24a) 

pi,  i2i3€  p 

where 

ni  ri2  n3 

J  (p )  =  I  S  I  Cii  i2  i3  Pi\  ii  i3  (2.24b) 

ii  =  0  i2  =  0  i3  =  0 

Ihe  constraint  set  P,  denoting  the  set  of  all  feasible  partitions,  is  formulated  as  the  set  of  linear 
equalities: 

n,  n; 

X  X  Piii2ij  =1  for  all  i3  =  1,2,...,  n3  (2.25a) 

1,  =  0  i;  =  0 
n,  n, 

X  Z  pin:n  =1  for  all  b  =  1,2 . n?  (2.25b) 

is  =  l>  i,  =0 
n:  n-j 

Z  Z  Pi,  i:  i>  =  1  for  all  i|  =  1,2 . m  (2.25c) 

i2  =  0  i,  =  0 

The  optimization  problem  formulated  in  l£qs.  (2.24)-(2.25)  is  a  generalized  3-D  matching  problem 
presented  later  in  Section  3. 
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2.4  Preprocessing  in  the  3-D  Matching  Problem  (Fine  Gatina) 


Consider  three  measurements,  z^,  zoj2  and  zjj  (with  at  most  one  dummy)  from  sensors  1,2  and 
3  respectively.  The  corresponding  3-tuple  Z j^j  may  be  considered  a  candidate  measurement-target 
association  if  and  only  if  c,^.^  <  0.  This  is  because,  if  cj  j  j  >  0,  the  addition  of  Z,t  H  j  to  the 
subset  Zt  of  measurement-target  associations  will  actually  increase  the  cost  J(p)  in  Eq.  (2.21). 
whereas  adding  {z^  ,  Z2i2  ,  z3^  }  to  the  subset  Zf  of  spurious  measurement  has  no  cost  penalty. 
Therefore,  all  3-tuples  Zt]  ^  with  Cj(  i2  i3  >  0  can  be  eliminated  from  the  list  of  candidate 
associations  by  setting  the  corresponding  binary  event  variables  pj  H  j3  =  0.  This  is  referred  to  as 
the'Tine  gating  scheme"  in  Section  3. 


III.  APPLICATION  RESULTS 


3.1  Scenario  Description 

If  the  scenario  is  reasonably  sparse  and/or  the  sensors  are  very  accurate,  one  may  be  able  to  place 
each  target  in  a  unique  plane,  and  eliminate  the  problem  of  ghosting.  A  relatively  simple  sorting 
algorithm  can  then  pick  the  feasible  solution.  However,  due  to  measurement  inaccuracies  and 
nonuniform  target  distribution,  multiple  targets  may  lie  in  a  plane.  In  addition,  due  to  the  finite 
resolution  of  sensors,  some  targets  are  unresolved  at  some  sensors.  The  scenario  can  be  further 
complicated  by  heavy  clutter,  and  missed  detections.  In  many  cases,  the  false  alarm  probabilities  are 
unknown  or  time-varying.  In  this  section,  we  evaluate  the  performance  of  our  data  association 
algorithm  under  such  adverse  conditions. 

The  elevation  fields  of  view  of  all  three  sensors4  are  (28°,  33°).  Sensors  1  and  3  are  2D  passive 
senors  measuring  azimuth  and  elevation  angles  of  targets.  The  azimuth  field  of  view  of  sensor  1. 
positioned  at  (-1(500,250,0).  is  (  58.2°,  63.2°  )  and  that  of  sensor  3,  positioned  at  (1000,250,0),  is 
( 1 16.8°,  121.8°  ).  Sensor  2  is  positioned  •”  (().(),())  and  has  a  head-on  view  of  the  target  cluster.  Its 
azimuth  field  of  view  is  (87.5°,  92.5°).  We  simulate  3  different  sensor  configurations  observing  the 
same  scenario.  In  configuration  1,  we  use  three  2D  passive  sensors.  In  configuration  2,  sensor  2  is 
a  2D  radar  measuring  azimuth  and  range  only.  In  configuration  3.  sensor  2  is  a  3D  radar  measuring 
azimuth,  elevation  and  range,  for  configurations  2  and  3,  the  range  field  of  view  of  sensor  2  is 
(2275,  2425)  distance  units. 

1  We  use  the  convention  that  Fast  is  0°  azimuth  and  horizontal  is  0°  elevation. The  reference  point  lor  our  coordinate 
system  is  sensor  2  located  at  (0.0.0).  Each  (’artesian  unit  distance  is  equivalent  to  HXX)  meters. 


We  simulated  64  targets  in  a  cluster.  They  were  arranged  in  four  vertical  planes  corresponding  to 
y  =  2075;  y  =  2050;  y  =  2025  and  y  =  2(XX),  respectively.  Each  plane  consisted  of  16  targets.  The 
typical  inter-target  spacings  are  about  20  units  in  x  and  z  directions  for  the  y=2075  plane;  this 
spacing  is  progressively  increased  for  the  planes  nearer  to  the  sensors.  The  scenario  thus  simulates 
64  targets  in  4  wavefronts  fanning  out  slightly  as  they  approach  the  coordinates  (0,0,0)-  In  addition, 
for  each  simulation  run,  we  randomly  perturb  the  target  positions  around  its  typical  position. 
Therefore,  the  actual  position  of  a  target  position  for  a  particular  run  is  given  by  (x  +  u,  y  +  v.  z  + 
w),  where  (x,y,z)  is  the  typical  target  position,  and  u,v,w  are  uniform  random  variables  in  the  range 
i+5,-5]. 

Finite  resolution  of  the  sensors  is  explicitly  modelled.  Results  are  presented  for  three  different 
sensor  resolution  capabilities.  For  passive  sensors  and  3D  Radars,  the  image  area  is  assumed  to 
consist  of  500x500  azimuth-elevation  cells  in  case  1;  iOOOx  1000  cells  in  case  2  and  2000x2000  cells 
in  case  3.  For  2D  Radars,  500,  1 000  &  2000  azimuth  cells  tire  assumed.  The  standard  deviation  of 
the  measurement  noise  is  assumed  to  be  1/5  of  a  resolution  cell.  Recall  that  the  Field  of  view  of  each 
sensor  is  5°  in  both  azimuth  and  elevation.  Therefore,  o()  =  =  0.002°  in  case  1,  Oq  =  = 

0.001°  in  case  2,  and  09  =  0^  =  0.0005°  in  case  3.  For  2D  and  3D  Radars,  three  different  range 
measurement  accuracies,  or  =  0.05.  0.02  and  0.01  (corresponding  to  50  meters,  20  meters,  and  10 
meters,  respectively),  were  simulated.  For  a  passive  sensor,  if  two  targets  are  close  enough  so  that 
both  their  azimuth  and  elevation  measurements  are  separated  by  less  than  5  s  andard  deviations,  a 
single  detection  with  an  averaged  measurement  is  reported.  For  a  3D  radar,  two  targets  are 
unresolved  and  reported  as  a  single  detection,  if  azimuth  ,  elevation  and  ranges  of  the  two  targets  are 
separated  by  less  than  5  standard  deviations.  Similarly,  for  a  2D  radar,  either  or  both  the  azimuth 
and  range  measurements  of  any  pair  of  targets  should  be  sufficiently  separated  to  be  able  to  resolve 
the  two  targets. 

The  detection  probability  of  each  sensor  was  assumed  to  be  0.95.  The  false  alarm  rate  was  fixed 
at  10  per  resolution  cell  for  passive  sensors  and  2D  radars,  and  10  per  resolution  cell  for  the 
3D  radars.  This  resulted  in  rather  heavy  clutter  foi  sensors  in  some  cases.  For  example,  for  a  passive 
sensor  with  2000x2000  azimuth-elevation  cells,  the  number  of  false  alarms  per  sensor  report  is  a 
Poisson  random  variable  with  mean  =  10 -\x20(X).x2(X)0  =  40,  which  is  comparable  to  the  number  of 
targets  present  in  the  scenario!  Nevertheless,  this  heavy  clutter  constitutes  a  hypothetical,  yet 
possible,  surveillance  scenario. 


3.2  Results  for  Different  Sensor  Configurations 


Table  I  presents  simulation  results  for  the  3  passive  sensor  case.  On  the  average,  63  targets  are 
detected  by  2  or  more  sensors,  52  of  which  are  detected  by  all  three  sensors.  The  results  demonstrate 
a  uniform  association  accuracy  of  95%,  in  spite  of  the  heavy  clutter  (an  average  of  38  false  alarm 
reports  from  each  sensor)  in  case  3. 

In  many  surveillance  scenarios,  accurate  3D  radars  are  also  available.  For  this  simulation.  Sensor 
2  was  replaced  by  a  3D  Radar.  The  3D  radar  measures  full  target  positions.  This  information 
appeared  to  aid  the  gating  scheme,  resulting  in  a  sparse  assignment  graph  and  approximately  25% 
reduction  in  the  CPU  time  over  the  3  passive  sensor  case.  Moreover,  the  association  accuracy  and 
position  estimates  are  also  marginally  improved,  as  shown  in  Table  II.  Table  III  presents  the  results 
for  different  range  measurement  accuracies  of  the  3D  Radar.  An  improvement  of  range  accuracy  has 
little  effect  on  the  association  accuracy  for  this  particular  scenario. 


Case  1 
500  cells 

Case  2 
1000  cells 

Case  3 
2000  cells 

Total  Number  of  False 
Alarms  in  scenario 

9.21 

31.5 

114 

Targets  detected  by  2 
or  mor^  sensors 

63.13 

63.02 

62.74 

Targets  detected  by 
only  2  sensors 

1 1.58 

11.63 

1 1.77 

Number  after 
Coarse  Gatine 

240.39 

220.8 

214.8 

Number  after 

Fine  Gating 

240.35 

220.8 

214.8 

Average  CPU  Time 
(seconds;  25MH/.-386i) 

19.5 

19 

19.3 

Number  of 
Identified  Targets 

68.08 

67.58 

69.26 

Percent  Correct 
Association 

94.8 

95. 1 3 

94.95 

Average  Error  in 
Position  Estimate 

0.147 

0.074 

0.037 

TABLE  I  :  Results  of  100  Monte-Carlo  runs  for  the  64  target  scenario.  (Sensor  configuration  1  - 
three  passive  sensors) 


Finally  in  Tables  IV  and  V  we  present  the  results  for  sensor  configuration  3,  in  which  sensor 
number  2  is  replaced  by  a  2D  Radar.  Since  the  2D  sensors  do  not  measure  elevation  angles  of  the 
target,  gating  using  hinge  angles  is  not  possible.  This  results  in  inefficient  gating  and  causes  CPU 
times  as  high  as  10  times  the  3  passive  sensor  case.  However,  the  association  accuracy  is 
approximately  the  same  as  that  of  the  3  passive  senor  case. 


Case  1 
500  cells 

Case  2 
1000  cells 

Case  3 
2000  cells 

Total  Number  of  False 
Alarms  in  scenario 

1 1.75 

29.24 

97.3 

Targets  detected  by  2 
or  more  sensors 

63.2 

63.42 

63.3 

Targets  detected  by 
only  2  sensors 

12.45 

10.38 

10.86 

Number  after 
Coarse  Gating 

239.61 

224.68 

215.84 

Number  after 

Fine  Gating 

208.54 

206.99 

202.6 

Average  CPU  Time 
(seconds;  25MHz.-386i) 

15.88 

16.44 

16.02 

Number  of 
Identified  Targets 

63.87 

64.06 

65.18 

Percent  Correct 
Association 

96.31 

96.94 

96.94 

Average  Error  in 
Position  Estimate 

0.085 

0.052 

0.031 

TABLE  II  :  Results  of  100  Monte-Carlo  runs  for  the  64  target  scenario.  (Sensor  configuration  2  - 
two  passive  and  one  3D  radar) 


500  resolution  cells 

a  =  50  m 
r 

a  =  20  m. 
r 

a  =  10  m. 
r 

Total  Number  of  False 
Alarms  in  scenario 

1 1.75 

13.31 

15.6 

Targets  detected  by  2 
or  more  sensors 

63.2 

63.22 

63.2 

Targets  detected  by 
only  2  sensors 

12.45 

1 2.2 

12.3 

Number  after 
Coarse  Gating 

239.61 

244.27 

235.09 

Number  after 

Fine  Gating 

208.54 

213.05 

205.28 

Average  CPU  Time 
(seconds;  25MHz-386i) 

15.88 

16.56 

17.02 

Number  of 
Identified  Targets 

63.87 

63.96 

63.61 

Percent  Correct 
Association 

96.31 

96.6 

96.25 

Average  Error  in 
Position  Estimate 

0.085 

0.075 

0.072 

TABLE  III  :  Results  of  100  Monte-Carlo  runs  for  the  64  target  scenario.  (Sensor  configuration  2 
two  passive  and  one  3D  radar) 


TABLE  IV  :  Results  of  100  Monte-Carlo  runs  for  the  64  target  scenario.  (Sensor  configuration  3 
two  passive  and  one  2D  radar) 


1  4 


500  resolution  cells 

a  =  50  m. 
r 

a  =  20  m. 
r 

a  =  10  m. 
r 

Total  Number  of  False 
Alarms  in  scenario 

9.4 

13.9 

21.9 

Targets  detected  by  2 
or  more  sensors 

63 

63.1 

63.1 

Targets  detected  by 
only  2  sensors 

1 1.4 

11.4 

11.4 

Number  after 
Coarse  Gating 

955.4 

1022.7 

1059.17 

Number  after 

Fine  Gating 

304 

298.5 

296.5 

Average  CPU  Time 
(seconds;  25MHz-386i) 

154 

165.1 

166.7 

Number  of 
Identified  Targets 

70.4 

72.6 

73.4 

Percent  Correct 
Association 

94.6 

94.5 

94.5 

Average  Error  in 
Position  Estimate 

0.101 

0.092 

0.092 

TABLE  V  :  Results  of  100  Monte-Carlo  runs  for  the  64  target  scenario.  (Sensor  configuration  3  - 
two  passive  and  one  2D  radar) 


The  association  accuracy  of  the  algorithm  was  about  95%  for  all  the  sensor  configurations  used. 
In  fact,  the  association  accuracy  appears  to  be  independent  of  the  sensor  type  and  resolution 
capabilities.  The  5%  missassocication  was  due  to  the  poor  target  geometry.  Although  the  field  of 
view  of  each  sensor  was  5°  in  azimuth  and  elevation,  all  the  targets  were  located  in  a  cluster 
spanning  less  than  2°  in  azimuth  and  elevation.  The  targets  were  arranged  in  four  closely  spaced 
vertical  planes.  In  each  vertical  plane,  the  targets  were  placed  in  a  regular  rectangular  grid.This 
causes  some  ghosting  and  resolution  problems.  For  each  run,  the  target  positions  were  perturbed  by 
±5  units  in  each  direction.  A  significant  number  of  targets  (about  16  in  the  500  cell  resolution  case  in 
Table  I)  could  not  be  placed  on  unique  planes  and  an  average  of  three  targets  were  unresolved  per 
sensor  list  due  to  random  alignment  of  targets  in  the  back  plane  behind  those  in  the  front  plane.  In 
higher  resolution  cases,  the  false  alarm  rates  were  significantly  higher.  Therefore,  the  advantage 
gained,  if  any,  by  higher  sensor  accuracy,  was  mitigated  by  the  large  number  false  alarms. 

The  average  number  of  targets  detected  by  all  three  sensors  is  approximately  52,  about  1 1  other 
targets  are  detected  by  only  two  sensors  as  a  result  of  non-unity  sensor  detection  probability  and 
finite  resolutions  of  sensors.  For  the  500  resolution  cell  case  in  Table  I,  for  example,  an  average  of 
2.5  'argets  per  list  were  unresolved,  and  another  3.2  missed  due  to  nonunity  sensor  detection 


probability.  The  data  association  algorithm,  however,  consistently  identified  an  average  of  60  of  the 
63  targets  detected  by  two  or  more  sensors,  thus  illustrating  the  capability  of  the  algorithm  to 
integrate  two-sensor  and  three-sensor  detections.  The  algorithm  is  also  remarkably  robust  to  heavy 
clutter.  Even  w-ith  38  false  alarms  per  list,  which  translates  to  6  false  reports  for  every  10  targets,  the 
algorithm  exhibits  negligible  degradation  in  association  accuracy. 

The  average  CPU  time  required  by  the  3-D  Matching  algorithm  on  a  SUN386i  computer  is 
approximately  3  seconds.  The  average  CPU  rime  required  by  the  entire  data  association  algorithm  for 
sensor  configurations  1  and  2  (Tables  I-III)  was  between  15  and  20  seconds.  Therefore,  a  major 
part  of  the  time  (upto  80%)  is  spent  in  the  cost  assignment  phase  (non-linear  Least  Squares).  The 
coarse  gating  scheme  based  on  hinge  angles  is  both  cheap  and  efficient.  However,  the  final  cost 
assignment  phase  includes  the  formation  of  nonlinear  least  squares  estimates  of  true  target  positions 
from  measurements  in  the  candidate  association  -  which  typically  take  about  0.05  seconds  per 
candidate  association.  An  increased  number  of  candidate  associations  would  therefore  result  in 
unacceptably  long  computation  times.  Note  that  for  denser  clusters,  involving  multiple  targets  in  the 
same  ghosting  plane,  the  number  of  candidate  associations  could  increase  dramatically. 

The  2D  radars  do  not  measure  the  elevation  of  the  targets.  It  is,  therefore,  not  possible  to  form 
hinge  angles  for  detections  by  the  2D  radar.  This  results  in  inferior  coarse  gating  and  a  large  number 
of  candidate  associations.  It  also  causes  an  increased  number  of  "ghost"  associations,  as  is  evident 
from  the  increased  number  of  "identified  targets"  in  tables  IV  and  V. 

Note  that  the  cost  computation  phase  is  highly  parallelizable,  Therefore,  in  time  critical 
applications,  costs  of  candidate  associations  can  be  computed  independently  of  each  other  on 
multiple  processors,  resulting  in  a  linear  speedup  with  increasing  numbers  of  processors. 


IV.  CONCLUSIONS 

Any  large-scale- surveillance  and/or  defense  system  is  intrinsically  a  multisensor-multitarget 
system,  e.g.,  air-traffic  control  systems,  a  navigation  and  guidance  system  or  the  Space  Surveillance 
and  Tracking  System  (SSTS).  Many  of  these  systems  employ  a  wide  variety  of  sensors  (  Radar,  IR 
detector,  sonar  etc.).  In  this  paper,  we  presented  an  algorithm  to  integrate  reports  from  multiple 
heterogeneous  sensors  to  estimate  target  positions  in  a  dense  target  environment. 

The  data  association  algorithm  presented  here  has  robust  performance  in  the  presence  of  very 
heavy  clutter.  It  deals  with  two  sensor  and  three  sensor  detections  in  an  unified  framework.  Even 
though  we  intentionally  simulated  a  reasonably  difficult  sensor-  target  geometry,  the  data  association 
algorithm  produced  consistently  good  association  accuracy  (~  95%),  even  though  about  17%  ot  the 


targets  are  detected  by  only  2  sensors.  Furthermore,  close  to  half  the  detections  at  each  sensor  were 
false  and  in  spite  of  this,  the  oveiall  performance  is  remarkably  good  -  only  10%  extra  (false  )  targets 
were  accepted  by  the  data  association  algorithm. 

In  this  paper  we  simulated  various  sensor  configurations.  The  three  passive  sensor  configuration 
performs  satisfactorily,  although,  replacing  one  of  the  passive  sensors  with  a  3D  radar  increases  the 
association  accuracy  by  about  1%.  A  3D  radar  also  reduces  the  number  of  candidate  associations  and 
hence  the  time  required  to  assign  costs  to  the  associations.  Moreover,  the  graph  for  the  3-D  matching 
problem  is  sparser  compared  to  the  three  passive  sensor  case,  which  also  speeds  up  the  matching 
algorithm.  The  overall  savings  in  CPU  time  is  about  25%  compared  to  that  of  a  three  passive  sensor 
case.  The  2D  radar  does  not  measure  the  elevation  of  the  source  of  detection;  hence,  hinge  angle 
gating  is  not  possible  for  associations  involving  measurements  from  2D  radar.  This  result  in  an 
increase  in  the  number  of  candidate  associations  and  upto  10  fold  increase  in  CPU  time  compared  to 
the  three  passive  sensor  case.  The  data  association  algorithm  could  benefit  from  a  computationaly 
cheap,  yet  efficient,  gating  scheme  for  2D  radars. 

The  challenge  in  tracking  problems  is  not  only  to  estimate  positions,  but  also  to  form  tracks  and 
estimate  the  velocity  and  acceleration  of  each  target.  The  data  association  problem  can  be 
reformulated  to  associate  data  from  multiple  scans  from  multiple  sensors,  and  to  form  estimates  of 
target  states.  The  optimization  problem  can  then  be  solved  using  a  multi-dimensional  matching 
problem  as  outlined  in  [  1 2 1  .  Moreover,  we  may  virtually  eliminate  the  ghosting  problem  in  target 
position  estimation  by  associating  angle  only  measurements  of  four  or  more  passive  sensors.  The 
price  update  in  [9,10]  extends  naturally  to  M-dimensional  (  M  >  3)  matching  algorithms.  These 
issues  are  currently  under  investigation. 
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